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lir  FUCTS  OF  SIMULATOR  TRAINING  AND  PLATFORM  MOTION 
ON  AIR-TO-SURFACE  WEAPONS  DELIVERY  TRAINING 


I.  INTRODUCTION 

The  air-to-surfacc  mission  is  a major  role  for  the 
Tactical  Air  Command  (TAC).  Specialized  aircraft 
are  being  procured  to  support  this  operational 
requirement;  and,  as  occurs  v^th  the  acquisition  of 
all  weapons  systems,  new  procedures  and  equip- 
ment must  be  developed  to  train  personnel  for 
their  effective  utilization.  As  regards  both  of  these 
items,  the  greatest  amount  of  resources  will  be 
expended  initially  in  providing  simulation  capa- 
bilities for  pilot  training.  It  is,  therefore,  of  critical 
importance  that  the  simulator  deliver  the  cues 
essentia]  to  this  training  and  that  the  training  itself 
be  highly  efficacious.  The  research  reported  in  this 
study  deals  with  air-to-surface  simulation  training 
transfer  and  motion  cueing  effects  In  general,  and 
it  represents  a first  step  towards  achieving  these 
objectives. 

Background  and  Literature  Review 

The  foregoing  summarized  the  reusonn  for,  and 
purposes  of  the  study,  but  a brief  expairdon  of 
these  points  will  add  some  clarifying  details. 

Backer  L T\\o  Air  Force  plans  extensive 
simulatoi  /rocuroments  in  order  to  reduce  flying 
training  hours  while  maintaining  operational 
readiness.  In  light  of  this  fact,  it  is  highly  desirable 
to  deter  mine  the  effectiveness  of  candidate 
simulator  contlgu rations  for  specific  training 
applications  prior  to  their  acquisition  by  the  user. 
From  the  user's  viewpoint,  there  are  two  aspects 
to  this  process.  First,  tlie  simulation  must  provide 
the  cues  essential  for  training;  and  second,  there 
must  be  positive  training  transfer  from  the 
simulator  to  the  aircraft.  I'rom  a budgetary  stand* 
point,  tliose  two  requirements  are  valid,  but  the 
cost  element  must  be  considered  as  well.  Unneces- 
sary features  should  nut  be  purchased:  the 
simulation  must  not  only  be  effective,  but  also  it 
must  be  efnclcnt. 

One  expensive  fliglit  simulutor  feature,  of 
which  the  universal  essentiality  is  not  certain,  is 
platfonn  motion.  Tire  question  us  to  whetlier  the 
existence  of  simulator  platform  motion  enhances 
the  training  effectiveness  of  the  device  is  an  issue 
of  considerable  importance.  Using  a moving  plat- 
form to  provide  vestibular  and  kinestlictk  cues  to 
the  pilot  is  a costly  process.  Not  only  are  initial 


expenses  increased,  but  life-cycle  costs  are  also 
inflated.  Unless  some  positive  training  value  can  be 
demonstrated  for  the  presence  of  motion,  cost - 
avoidance  considerations  must  force  its  exclusion 
from  the  simulator. 

The  Air  Force  Human  Resources  laboratory 
(AFHRL)  has  completed  several  studies  which 
addressed  the  value  of  motion  cueing  to  the 
training  effectiveness  of  flight  simulators.  Tltese 
studies  have  provided  estimates  of  the  contri- 
bution of  simulator  motion  in  transfet  of  training 
to  the  aircraft;  however,  due  to  the  luck  of  visual 
scene  capabilities  for  air-tu-surfaco  weapons 
delivery  simulator  training,  they  addressed  only 
the  learning  of  aircraft  instrument  and  transition 
skills  and  did  not  address  maneuvers  involving  hlgli 
'*G"-low  altitude  tasks. 

AFHRL  recently  participated  in  u study  (ASD 
Project  2235)  which  facilitated  the  development 
of  a visual  scene  capability  on  the  Advanced 
Simulator  for  Pilot  Training  tiiut  included  a 
conventional  air-to-surface  weapons  delivery 
complex  and  the  display  of  tactical  targets  for 
more  advanced  operational  training.  Tlik  visual 
capability,  when  combined  with  objective  scoring 
strategies  and  the  existing  motion  system 
permitted  the  investigation  of  the 
transfer-of-tralning  phenumctia  described  in  the 
present  study. 

Air-to-surface  weapons  delivery  is  a higli  risk 
area  of  training  for  newly  rated  pilots.  Large  Air 
Force  expenditures  for« simulation  of  this  activity 
are  imminent.  Therefore,  a detennination  of  both 
the  feasibility  of  simulator  training  in  this  area  and 
an  assessment  of  the  contribution  of  platform 
motion  to  simulator  effectiveness  iit  this  context 
was  deemed  essential. 

lAterature  Review,  There  have  been  numerous 
studies  investigating  the  effects  of  platfonn 
motion  upon  piloting  tusks.  Many  of  these  have 
been  directed  toward  determining  tlie  dcgccs  of 
freedom  required  for  motion  systems  in  particular 
settings,  as  well  as  what  levels  of  tulclity  are 
needed  (Bergeron,  1970;  Jacobs,  Williges.  & 
Roscoe,  1973).  This  body  of  research,  however,  is 
equivocal,  and  findings  have  not  always  been 
consistent  from  study  to  study. 
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Certain  studies  have  shown  that  tnollon 
produces  improved  pilot  performance  in  con- 
trolling the  simulator  (B<jrlace,  1967;  Brown, 
Johnson,  & Mungall,  I960).  In  this  vein,  Rathert, 
Creer,  and  Sadoff  (1961) ‘demonstrated  that 
varying  tJrc  fidelity  of  motion  cueing  directly 
affected  the  pilot’s  perfomiance  in  the  simulator. 
KooncQ  (1974)  investigated  tire  training  effective- 
ness of  platform  motion  using  three  conditions  of 
motion  cueing  (i.e.,  no  inutiom  sustained  motion 
cueing,  and  wusliout  motion  cueing).  This  study 
reported  un  increase  in  pilot  performance  in  the 
simulator  when  either  condition  of  motion  cueing 
was  present. 

From  Koonce's  study,  it  is  seen  that  tlic 
evidence  supporting  the  positive  effects  of  lijgh 
fidelity  niotinn  cueing  is  not  firmly  established, 
Dcmarce,  Norman,  and  Mutheny  (1965)  concluded 
that  in  many  Instances  the  level  of  fidelity  could 
be  reduced  without  any  uppreduble  performance 
decrement  on  tracking  tasks.  Huddleston  (1966) 
reported  tiiat  motion  may  not  be  necessary  for 
those  piloting  tasks  performed  in  the  more  stable 
flight  regimes,  although  it  may  be  bcnefl*  lal  in 
highly  dynamic  regimes.  Finally,  a follow-on  study 
to  Koonce  (Jacobs  8l  Roscor,  1975)  may  have 
revealed  a critical  facet  of  the  issue.  It  was  found 
that  pilot  performance,  In  terms  of  errors  com- 
mitted, improved  in  the  simulator  with  the 
presence  of  cither  tu>rmal  wasliout  motion  or 
random  washout  motion  where  the  latter  condi- 
tion provided  appropriate  onset  cueing,  but 
random  directional  cueing.  Perhaps  it  may  be  that 
motion  serves  only  to  alert  the  pilot  to  a change  in 
conditions  and  rarely  has  any  intrinsic  stimulus 
value  beyond  this  point  (Irish,  Grunzke,  Gray,  & 
Waters,  1977).  Simple  “movement,”  not 
complexly  driven  motion  platforms,  may  provide  a 
sufficient  condition  for  simulation. 

A plethora  of  studies  attest  to  the  training  value 
of  simulation  (Caro,  1970;  Prophet,  Caro,  & Hall, 
1972;  Reid  & Cyrus,  1974;  Woodruff  & Smith, 
1974),  But  the  effectiveness  of  simulator  training 
varies  enormously*  when  viewed  acron  specific 
applications,  and  it  It  wise  to  pretest  'whenever 
possible,  in  addition,  individual  differences  in  the 
student  population  may  produce  widely  different 
effects  of  such  training,  'fhe  present  study  was 
designed  to  investigate  these  possibilities  as  well  as 
provide  baseline  data  for  envisioned  air-to-surface 
simulator  training  programs 

Problem  Statement 

At  the  present  time,  TAC  air-to-surface  training 
is  taught  in  tactical  aircraft.  Ihis  procedure 


constitutes  a dangerous  activity  for  newly  rated 
pilots.  An  alternative,  if  demonstrated  to  be 
effective,  is  the  use  of  flight  simuJalorn  designed 
with  air-tO'Surfacc  capabilities.  A related  Issue  is 
the  efficiency  of  this  training  for  student  pilots  of 
differing  ability  levels,  Is  the  payoff  of  simulator 
training  relatively  equal  for  all  students,  or  do 
some  profit  to  a greater  extent  than  others? 
Finally,  if  it  were  simwn  that  simulator  platform 
motion  does  not  increase  the  training  transfer  to 
the  aircraft,  significant  reductions  In  the  life-cycle 
costs  of  the  device  would  be  realized. 

Objectives 

The  objectives  of  this  research  were  to  deter- 
mine: (a)  the  extent  to  wliich  generalized, 
conventional,  air-to-surface  weapons  delivery 
training  in  the  Advanced  Simulator  for  Pilot 
Training  transfers  to  a specific  aircraft;  (b)  the 
contribution  of  slx-dcgreo-of-freedom  plat  form 
motion  to  the  transfer  of  training  from  simulator 
to  aircraft;  and  (c)  the  differential  effects,  If  any, 
of  this  simulator  training  on  student  pilots  of 
differing  ability  levels. 

Study  Rationale 

The  main  theme  followed  throughout  the  study 
was  that  the  approach  should  be  intensely  realistic 
in  terms  of  Air  Force  operations.  Accordingly,  it 
was  decided  to  select  a homogenous  group  of 
inexperienced  pilots  who  had  already  been 
identified  for  figliter  ^ training,  trfiin  them  on 
specified  tasks  in  the  simulator,  then  measure  their 
performance  on  the  same  tasks  in  un  aircraft  on  an 
actual  gunnery  range.  Tlie  result  was  a simple 
study,  easily  and  quickly  understood,  that 
produced  information  directly  applicable  to  Air 
Force  areas  of  concern. 

A major  decision  made  in  establishing  the 
simulator  configuration  dealt  with  the  G-Seat.  Tlie 
G-Seat  can  serve  as  a platform  motion  surrogate  by 
providing  vestibular  and  kinesthetic  cues,  (f.thc 
G-Seat  had  been  included  as  ufi  independent 
variable,  two  additional  groups  of  subjects  would 
have  been  required  for  the  experiment.  This  action 
would  have  increased  the  size  and  duration  of  the 
'effort  by  two-thirds.  Due  to  the  urgent  demand 
for  immediate  information  on  platform  motion 
effects,  a larger  study  was  not  u viable  option. 
Consequently,  it  was  decided  that  the  G-Scat 
would  be  a fixed  study  factor. 

Ihe  fully  operative  motion  condition  was 
chosen  for  the  G-Seat  configuration.  The  reason 
for  this  selection  was  that,  unlike  motion 


6 


})hiilnmis,  Imc  incliismn  of  a (i-Scal  ijJds  very  little 
In  oitliof  tlu*  iiaiuisitinn  oi  liic<ydc  costs  of  a 
flight  simulator.  Since  ti  sccnicU  higjily  probable 
tliat  all  fiituii'  sophist’ ’ated  fight  sinmlators 
would  be  procvircd  with  Ci-Scals,  it  was  believed 
liiat  the  study  results  would  have  greater  validity  if 
the  G-Scat  were  operative  during  the  simulator 
training  phase. 

Xlic  aircraft  selected  for  the  data  flights  was  the 
primarily  because  F-5H  training  is  accom- 
plislv‘d  at  Williams  Air  Force  Base,  Arizona,  and 
the  proximity  of  instructor  pilots  and  aircraft 
greatly  simplitlcd  this  poition  of  the  data 
collection.  An  additional  reason  for  its  selection 
was  because  it  is  a two-seut  aircraft  and  two  data 
collection  fligltts  per  subject  could  be  scheduled 
with  very  little  checkout  time  in  the  aircraft,  since 
an  instructor  would  be  on  board  to  perform  all 
tasks  not  required  as  part  of  the  study  (as  well  as 
priwiding  adequate  flight  safety),  liad  the  F*SB 
not  been  used,  it  would  have  been  necessary  to 
conduct  the  study  as  part  of  u formal  combat  crew 
training  fCCT)  program  where  the  subjects  would 
have  received  a complete  checkout  in  the  CCTair- 
Cl  aft.  Tins  miglit  have  caused  safety  problems  due 
to  dissimilar  figlit  characteristics  between  the  air- 
craft and  the  simulator.  Tlicsc  problems  were 
avoided  by  using  the  F-5B.  Tins  point  will  bo 
discussed  further  in  the  Methods  and  Procedures 
section. 

Gaining  support  for  this  project  was  greatly 
facilitated  because  of  its  "training/rcscarch” 
aspect.  Not  only  woviid  impt)rtant  research  issues 
be  examined,  but  valuable  training  would  be 
gained  by  the  participants.  Air-to-surface  training 
has  always  leprescntcd  one  of  the  most  dlftlcult 
areas  to  train  in  the  aircraft.  A chance  to  obtain 
some  pretruining  for  students  prior  to  their  arrival 
at  CCT  was  readily  endorsed  by  the  training 
squadrons. 


II.  Ml^:THOn  ANDPROCIiDURES 

As  stated  in  tire  rationale,  a major  objective  of 
the  approach  was  that  the  study  be  performed 
within  the  context  of  typical  Air  Force  training 
operations.  This  requirement  was  the  determining 
factor  in  tl\e  study’s  methodology. 

Subjects 

The  pcrwmnel  who  serve  as  subjects  in  sinuila- 
tion  research  are  usually  found  to  be  the  major 
single  source  of  variance  when  the  analysis  of  the 
experimental  results  is  completed.  In  this  study, 


great  care  wa.s  taken  to  remove  much  of  this 
unwanted  variance  as  possible  tluouglr  the  use  of 
judicious  selection  technique}!  and  counter- 
balancing. 

Subject  Background  and  Selection.  It  was 
decided  that  the  most  representative  source  of 
subjects  would  be  recent  undergraduate  pilot 
training  (UPT)  graduates  who  had  been  identified 
for  fighter  assignments.  Tliese  novice  pilots  receive 
a short  6-week  fighter  lead-in  training  course  at 
Holloman  Air  Force  Base,  New  Mexico,  after 
graduation  from  UfT  and  prior  to  their  arrival  at 
CCT  lor  their  respective  aircraft.  Tlic  lead-in 
course  is  designed  to  improve  formation  flying 
skills  and  to  provide  an  Introduction  to  high 
performance  maneuvering  and  to  air-to-ground 
weapons  delivery.  At  the  time  of  this  study,  the 
course  contained  1^^  sorties  in  the  two-placc  T-18 
aircraft,  the  same  aircraft  flown  In  UPT. 

The  subjects  were  given  the  entire  lead-in  train- 
ing course  with  the  exception  of  the  air-to-surface 
indcKtrination.  Hiis  required  deleting  two  T-38 
sorties  which  were  replaced  by  two  sorties  in  the 
F-SB  at  Williams  Air  Force  Ikise,  Arizona,  as  part 
of  the  study.  The  two  sorties  deleted  at  Holloman 
Air  Force  Base  are  flown  “dry"  since  the  T-38 
does  not  have  the  capability  to  deliver  ordnance, 
whereas  tlic  two  F-5B  sorties  gave  the  subjects  the 
opportunity  to  drop  12  BDU-33  practice  bomba 
which  would  serve  as  ciaerion  measures. 

Actual  selection  of  the  subjects  required  several 
steps.  First,  the  Air  Force  Military  Pcraonncl 
Center  pipeline  management  section  provided  a list 
of  potential  subjects  who  hud  cnoiigli  time 
available  between  lead-in  training  and  their  CCT 
reporting  dates  to  allow  a 2-wa‘k  tnur  oi  duty  for 
this  study.  From  this  list,  only  those  with  no  prior 
Air  Force  service  time  or  significant  fixed-wing 
flying  experience  otlicr  than  were  selected  tor 
possible  parlicipution  in  the  study.  Finally,  the 
actual  subjects  were  randomly  selected  from  this 
rcduoid  list  and  their  names  sent  to  the  training 
squadron  at  floUman  AFB.  At  this  point  the 
training  squadron  devHo|X'd  a rank-ordering  of  the 
subjects.  This  runk-^irdcrlng  was  made  on  the  basis 
of  the  students’  perforimuice  during  lead-in 
training. 

Subject  Aasignrnent.  Upon  the  completion  of 
lead-in  training,  the  student  pilots  were  sent  to 
Williams  AFB  in  groups  of  six.  It  was  necessary  to 
use  four  lead-in  training  classes  In  order  to  produce 
a total  N of  24  students,  eiglit  subjects  assigned  to 
each  of  three  groups. 
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1 ho  t;iiikin^;s  oioi'*.  Ity  Ihe  squarLlron  al 
Mnlloinan  A I'M  I ho  basis  for  assi|uiing  oadi 

siib)ocl  mil'  oilhoi  a onntrol  K,ioiip  which  would 
tca  ivo  no  siniulaloi  (raining,  oi  one  of  iwn  uxj>cri- 
menial  r.imipy  (siibilividcd  into  motion  and  no- 
moiion  groups).  Mor  tlic  first  class*  the  subjects 
ranked  1 and  (>  were  placed  in  tlic  motion  group,  2 
and  5 in  the  no-inotion  group,  and  d and  4 in  the 
control  group.  Class  two  grouped  students  2 and  5 
into  iho  motion  comlitioii,  ^ and  4 into  the  no- 
inotion  condition  and  1 and  6 were  used  as 
controls  Class  three  used  the  laat  available 
combination  and  class  four  used  the  first 
conhination  over  again.  I'ortunately,  this  counter- 
br.liindng  on  student  performance  also  produced 
groups  that  were  well  equated  from  the  standpoint 
of  mean  fixed-wing  lime.  Tlie  control  group 
averaged  hours,  the  motion  experimental 
group  averaged  27b  hours,  and  the  no-motion 
cx{X‘riMiental  group  averaged  248  hours.  These 
minor  diffetenecs  were  not  statistically  significant 
at  the  five  percent  level  of  confidcfice. 

It  is  believed  that  this  procedure  acamiplished 
its  purposes:  namely,  subject  groups  matched  as  to 
ability,  and  u .study  that  would  allow  valid  generat- 
i/atiotis  on  the  benefits  of  air*tu  surface  simulator 
uaining  to  the  appropriate  AJr  Force  population. 

Imstructur  Pilots 

With  one  exception,  the  study’s  instructor 
pilots  were  drawn  from  the  425th  Tactical  Fighter 
Training  LScjuadron  stationed  at  Williams  AFB.  All 
Instructor  Plltds  were  highly  experienced  In  alr-to- 
surface  weapons  delivery  and  were  thorouglily 
briefed  on  the  purposes  of  the  study  and  their  jobs 
within  it.  Sj>ccial  training  on  the  ASPT  console 
operation  and  advanced  training  tcaturcs  capa- 
bilities wa.s  given  to  the  Instructor  Riots  who 
ndtninistcrcd  the  simulator  training. 

Apparatus 

llic  apparatus  used  in  the  study  consisted  of 
two  devices;  the  Advanced  Simulator  for  Pilot 
Training  (ASPT),  and  the  F-5B  aircraft. 

457*7!  Tlic  ASI*T  located  at  the  Air  Force 
Mumun  H‘::>ourccs  Uboratory/Flylng  Training 
Division  {Al'HRT/FT)  was  used  for  the  training 
[Hirtiori  of  the  study.  TechnicaJ  references  for  this 
device  are  found  in  Hagin  and  Smith  (1974);  and 
KuM  ( 1975),  but  a short  description  will  be  given. 


A.SPT  has  two  fully  iiisliuiiRiilcd  1'  .17  ciKjkpit.s 
imnjiilcd  upon,  six-dcgrci'-of •frccdtim  motion  plat- 
forms.  'Hic  synergistic  mol  ion  system  ha.s  six 
active  drive  legs  witli  approximately  5 feet  of 
vertical  travel  and  1 feet  of  hori/onla!  travel. 
Disf  I '»c»;rnent  capabilities  Hndiide;  pi!ch  20 
degrees  to  +30  degrees;  roll  +22  degrees;  and  yaw 
+32  degrees,  'lliese  displacements  are  intended  to 
provide  initial  (onset)  cues  for  all  maneuvers,  Ihc 
3 1 -bellow  pneumatic  Ci-scat  in  ASFf  is  designed  to 
provide  more  continuous  cues  tfian  the  motii>n 
platforn  and  accomplishes  this  by  the  orderly 
inflation  and  dctlatlon  t)f  the  belhms  in  response 
to  the  requirements  of  each  particular  maneuver, 

Ihe  visual  system  of  ASFt  is  comprised  of 
seven  36-inch  monocluomalic  cathode -ray  tubes 
placed  around  the  cockpit  giving  the  jMlot  +1 10 
degrees  to  40  degrees  vertical  cueing  and  +150 
degrees  of  hori/.ontal  cueing.  Tlic  computer- 
generated  visual  scene  has  the  capability  to  display 
infomiation  for  most  pertinent  ground  references 
(mountains,  runways,  hangars,  etc.)  witliin  a 
100-square-nautlcal-mlle  area  of  Williams  AFB. 
The  configuration  for  this  study  Included  the 
conventional  gunnery  range  visual  data  base 
developed  for  project  2235  and  the  depressible 
bombing  sight  (A-37  Optical  Siglit  Unit)  installed 
for  (hat  project  (Hutton,  Burke,  Fnglehart,  Wilson, 
Rumaglia,&  Schneider,  1976). 

Tlic  aerodynamic  inathcmatica]  models  driving 
the  si  in  111  at  or  arc  those  of  the  T-37  aircraft.  Hie 
feasibility  of  changing  these  models  to  increase  the 
per fo nuance  of  (he  simulator  to  more 
representative  airs|xjcds  and  handling  qualities  of 
flgbter-type  aircraft  was  investigated,  Intimates  of 
that  effort  placed  unacceptable  time  delays  on  the 
project  wliich  would  have  not  allowed  infnrm.'Mon 
to  be  provided  to  the  using  command  within  the 
required  time  frame. 

F\^l  'Die  F-5B  proved  to  he  an  excellent 
choice  us  the  criterion  test  vehicle  Ibr  measuring 
the  ability  of  the  subjects  to  perform  air-to-surface 
weapons  delivery.  As  mentioned  previously,  the 
flight  characteristics  of  the  l''•5B  are  similar  to 
those  of  the  T*3H  aircraft  which  tlic  subjects  had 
flown  for  upproximutely  110  hours  in  UFf  and 
another  20  hours  during  lead  in  truiiiing.  Differ- 
encesin  ojwrational  procedures  and  “switdmlogy” 
were  p re  brie  fed  prior  to  each  aircraft  mission  and 
presented  no  piobleins  during  the  data  collection 
flights. 
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liuleiHMulritl  Variiihlfs 

l‘oui  iiulopciulenl  variables  were  used  in  ibc 
study.  first  (d  these,  iraininji  conditions, 

represents  the  weapons  delivery  traininit  received 
by  the  subjects  at  Williams  AMi  Hiere  weie  throe 
levels  oi  this  variable:  no  simulator  training 
((\Miirol  Ciroup);  simuialur  training  with  plath)nn 
motion  (Experimental  (iroup  1);  and»  simulator 
training  wiilmut  platform  motion  (Experimental 
Group  2).  Ihc  specific  syllabiLS  cunlonl  and 
student  How  for  iill  three  conditions  will  be 
covered  in  u subsequent  section. 

Ibe  second  independent  variable  was  simulator 
platform  motion.  ITicrc  were  two  levels  of  this 
variable:  level  one  used  the  full  six-degree-of- 
fieedimi  platf  irtn  motion  available;  for  level  two 
the  plutform  was  stationary. 

ITic  third  independent  variable  consisted  of  the 
weapons  delivery  tasks  t^rfonned  by  the  study 
subjects.  Iluee  different  weapons  delivery  tusks 
were  selected:  tltc  higli  drag  10-dcgrce  dive  angle; 
the  higli  dng  15  ‘dcgtcc  dive  angle;  and  the 
30-degree'ungle  dive  bomb.  Specific  delivery 
parameters  arc  described  in  Appendix  A. 

Hie  final  independent  variable,  initial  Hying 
ability,  was  chosen  to  give  greater  experimental 
control  and  (o  permit  group  comparisons  on  the 
cfl'ects  of  simulutor  training  as  a function  of 
student  ability.  As  stated  above,  the  subjects  w'cre 
rank -ordered  by  the  training  squadron  ul 
Holloman  Al’B  on  the  Hying  ability  they  demon- 
strated during  Icuddii  training.  Tlris  served  two 
purposes:  first,  it  allowed  counterbalancing  ol 
subjects  so  that  there  were  mutclied  grou])s  in  the 
three  training  conditions;  second,  it  made  possible 
compansons  on  the  value  of  sinmlutoi  training 
between  students  judged  to  have  greater,  iis 
contrasted  to  lesser,  initial  Hying  uhility. 

Study  Design 

Ibe  design  used  Ihrougliout  the  study  was  an 
elementary  two -factor  “mixed”  analysis  of 
variance  classilled  by  lindquist  ( as  a TyjK*  I 
design,  Hie  basic  design  lent  itself  nicely  to  the 
analysis  recpiireinents  because  for  two  level  con- 
trasts (i.e.,  motion  versus  no-motion,  superior 
versus  inferior  students),  it  conveniently  collapses 
in  simpler  paradigms.  'Ilic  three  weapons  delivery 
tasks  (i.c.,  10-degree,  1 5*dcgrec,  and  '^O-degree  di\e 
angles)  comprised  one  factor  of  this  design,  while 
group-associated  independent  variables  (i.e., 
conditions  of  training,  simulutor  motion  configura- 
tions, and  initial  flying  uhility)  constituted  the 
other. 


i’he  ilesig.ii  w.is  Hsi'il  b'l  tlir  iiiiiv.ii i;iU‘ 

analyses  of  variance  peilomieil  (m  the  liala  as  well 
as  Uie  two  multivariale  ca.ses. 

Dependent  Variables 

'Hi ere  were  tliree  inimary  set.s  of  dejX'iKlent 
variables  a\ed  in  the  study,  and  twi»  of  these  sets 
were  dicholomnus. 

Aircruji  l''rf(nni(vuv  Ihpcfulcnt  {’uriuhlrs. 
Two  classes  of  de|>endcnt  measures  resulted 
directly  from  student  pcrldrnuuice  data  obtained 
during  the  l'-5B  criterion  lliglits,  Hie  first  of  tliese, 
bomb  delivery  accuracy,  were  sctires  from  practice 
bombs  dropiwd  on  the  conventi(mal  gunnery  range 
at  (lila  Bend,  Ari/orui.  fbe  second  dejxmlcnt 
variable  based  on  Hying  performance  was 
Instructor  pilot  ratings.  Instructor  pilots  Hying 
with  the  students  in  ihe  aircraft  gave  subjective 
ratings  on  a scale  of  0 lu  4 on  eacii  bomb  delivery 
attempt,  which  wore  converted  into  standard 
suircs  (mean  of  50,  standio  deviation  of  10)  for 
analytic  purposes.  Those  ratings  covered  overall 
Hying  ixjrlbrinancc  in  the  bombing  pailern,  but 
excluded  any  considoralinn  of  the  uelual  bomb 
score. 

Simtdator  Pvrformmuv  Dv/wndont  I'mahlvs. 
Similar  to  the  above,  there  were  two  classes  of 
dependent  measures  that  resulted  I’roin  sludeiP 
performance  in  the  AS1*T.  llie  fust  oi  these,  bomb 
delivery  circular  error,  is  a measure  eoinparable  in 
every  respect  to  the  correspoiuling  measure 
observed  during  tlie  cheek  lides.  A scoring 
aigorithin  in  tlie  sinuilalnr  eonipuicr  ciij)lured  ;ill 
release  parameters  on  eaeb  delivery  and  eoniputed 
an  impact  distance  fiotn  the  target  cenlei. 

C'apab  ill  ties  ol  llie^  ASI*'I  were  also  uscil  to 
record  simulated  llight  paianieters  at  the  moment 
of  bi'inh  lelease.  Airspeeil,  iiltitude,  Cidoad, 
beading  and  dive  angle  were  printed  out  for  each 
weapotis  delivery.  These  were  ilie  parameters 
utilized  in  the  multivariate  analyses  ol  varlaneo. 

Suhfvct  Questionnuirr. . (^ucstimmaircs  were 
completed  by  all  students  at  tlu‘  end  of  training. 
(A  lacs'inile  of  tlie  iiueslioimaire  is  conlaitieil  in 
Appendix  B.) 

Syllabus  Development 

llie  fh>»  step  ill  the  syllalnis  developntetit  w;ls 
tr»  delermlne  the  tasks  to  he  Howti.  Ilie  tesiills 
fmin  project  showed  that  all  conventiixial 

weapon  deliveries  could  he  llown  m the  ASEf. 
‘niese  weapons  deliveries  cnulil  he  elassilled  Into 
til  ICC  general  categories:  loiwaid  1 1 ring,  (si  rale), 
low  angle  bombing,  ami  high-aiigle  Inunhiiig. 


Ik’lote  ihc  lo  bj  u ,cd  in  porforming  the 

cfitcnon  Uiskii  was  sdcclrd,  it  was  planned  to 
chiKtsc  one  task  lioin  each  Cr’/egoty.  However, 
when  tlte  I’  SH  became  the  weapons  platform, 
strafe  had  t(^  be  eliminated  from  consideration 
because  the  b-5B  docs  not  ,have  guns.  Rockets 
could  have  been  used,  but  simulation  of  that  capa- 
bility had  not  yet  been  developed  on  the  ASP!'.  It 
was  decided,  thercf(jrc,  to  use  two  low-angle 
bombing  events  and  one  high-angle  event.  The  two 
low'-angic  events  selected  were  10-  and  ! 5-degree 
simulated  high  drag  deh.veries. 

The  high  angle  event  selected  was  the  30-degree 
dive  bomb.  Tlic  sklDs  required  for  this  event  are 
somewhat  different  than  for  the  low-angle 
deliveries.  More  reliance  on  in-cockpit  instruments 
is  necessary  to  meet  required  release  parameters. 
Higher  angle  events  such  as  45  degree  or  60  degree 
were  eMminated  from  consideration  because  they 
were  not  performed  in  the  F-5B  aircraft  as  a part 
of  the  normal  training  course. 

Tlic  next  step  in  the  syllabus  development  was 
to  determine  how  the  deliveries  would  be  taught  in 
the  ASPT  and  how  they  would  be  performed  in 
tile  aircraft.  On  a conventional  gunnery  range,  if 
both  high-  and  low-angle  events  arc  to  be  flown, 
the  low-angle  events  are  flown  first.  This  is  done 
for  sevend  reasons,  but  primarily  for  time  and  fuel 
considerations.  Consequently,  this  low-to-high 
sequence  was  followed  throughout  the  study. 

A prototype  syllabus  was  established  and 
several  exi^erience  pilots  with  no  previous  air-to- 
surface  training  were  selected  to  conduct  a pretest 
of  the  mission  scenarios.  These  trial  runs  provided 
insiglit  into  the  amount  of  time  required  to 
conduct  the  training,  the  optimum  length  of  each 
sortie,  and  at  the  same  time  provided  experience  in 
console  operations  for  the  instructors  who  would 
be  doing  the  actual  training.  After  several  minor 
changes  were  made  to  the  syllabus,  the  course  of 
instruction  was  administered  to  a new  UPT 
graduate  with  flying  experience  similar  to  the 
aciunJ  subjects.  No  problems  were  encountered 
and  the  scqtiencc  and  instructional  techniques 
were  rmall/.cd  prior  to  arrival  of  the  Hnt  class  of 
subjects. 

Subject  Training 

After  tlicir  arrival  at  Williams  AFB,  all  of  the 
subjects  were  given  two  Llocks  of  “ground  schoor 
training  during  the  study.  The  first  block  was 
presented  on  the  first  morning  and  consisted  of  an 
introductory  briefing,  an  overview  of  the  study, 
and  a sliort  phase  review  of  air  to-surface  weapons 
delivery 


At  this  point,  the  control  group  was  separated 
from  the  experimental  groups  and  given  their 
second  bl(Kk  of  training,  an  orientation  to  tiv: 
F-SB.  (A  sample  training  schedule  appears  in 
Appendix  C.)  This  block  of  training  consisted  of 
instruction  on  aircraft  procedures  and  ended  with 
a test  on  critical  action  emergency  procedures 
which  were  required  knowledge  prior  to  flight.  For 
these  subjects,  tlie  remainder  of  the  first  day  was 
spent  on  the  flight  line  with  time  in  the  cockpit  to 
familiarize  them  with  armament  procedures  and 
switchology.  These  control  subjects  then  flew  their 
two  data  flights  in  the  F-5B  on  the  second  and 
third  days  (one  flight  per  day).  The  content  of  the 
flights  are  described  as  follows. 

After  receiving  the  first  block  ground  school 
with  the  control  group,  the  experimental  groups 
then  proceeded  with  their  simulator  training.  They 
did  not  receive  the  second  block  on  F-5B 
procedures  until  after  the  simulator  training  had 
been  completed. 

The  simulator  training  started  with  a 20-minute 
sound/slide  presentation  that  co^^ered  the  normal 
and  emergency  procedures  the  subjects  would 
need  to  know  prior  to  operating  any  of  the  simula- 
tion equipment.  A trained  operator  gave  each 
subject  an  individual  checkout  on  these  procedures 
in  the  simulator  cockpit  before  the  subject's  first 
mission.  This  operator  remained  on  duty 
throughout  the  training  periods  to  act  as  a safety 
observer. 

A schedule  of  the  simulator  training  is 
presented  in  Appendix  D.  The  syllabus  for  this 
training  was  diWded  into  eight,  1-hour  sorties.  A 
building  block  approach  was  followed  throughout. 
On  the  first  simulator  mission,  a short  familiar- 
ization flight  was  provided  prior  to  starting  the 
actual  weapons  delivery  training.  IDuringthis  time, 
the  subjects  experienced  the  control  forces  and 
trim  changes  that  would  occur  over  the  airspeed 
ranges  that  were  later  flown.  Characteristics  of  the 
simulator  visual  system  were  explained  so  thf 
subjects  were  well-adapted  to  the  outside-the- 
cockpit  environment. 

Afler  the  familiarization  period,  the  simulator 
was  initialized  to  the  gunnery  range  for  tlie  start  of 
the  air-to-surface  training.  The  events  were  taught 
in  sequence  starting  with  the  10-degree-dive-angle 
task.  The  delivery  was  introduced  with  a pre- 
recorded demonstration  of  the  base  leg  and  final 
approach  portions  of  the  pattern.  (See  Appendix 
A for  diagrams  of  the  complete  patterns.)  The 
student  was  then  *'reset“  to  the  same  starting 
point  and  allowed  to  practice  what  he  had  seen. 
Thb  part-task  approach  was  selected  to  take 
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advantage  of  tl»c  available  advanced  training 
features  such  as  problem  lrec/.e»  initiali/ation/ 
reset,  and  record/pluybucL  Alter  several  trials,  lire 
student  again  viewed  the  prerecorded  demon- 
stration. Tliis  presentation  was  dynamic  for  all 
night  instruments,  stick,  rudder,  and  throttles,  as 
well  as  the  visual  scene.  Tlie  student  then  flew  the 
part-task  pattern  again  with  his  own  performance 
recorded.  Wlicn  this  was  replayed,  he  had  instant 
feedback  which  he  could  use  to  analyze  his  own 
errors.  Tlte  instructor  pilots  used  tl^c  problem 
freeze  feature  frequently  to  stop  the  sequence  and 
to  point  out  what  tlie  student  should  have  been 
seeing  and  doing.  Finally,  the  full  pattern  was 
demonstrated  and  taught  in  much  the  same 
manner  as  the  part-task  pattern. 

The  second  and  third  missions  introduced  the 
15*  and  30-degree  tasks  using  the  same  procedures. 
Reinforcement  of  previously  learned  patterns  was 
accomplished  at  several  points  in  the  missions.  The 
instructor  pilots  used  mission  guides  in  order  to 
follow  the  sequence  exactly  on  each  sortie.  Thus, 
each  student  in  the  experimental  groups  received 
the  sami'  number  of  repetitions  on  each  of  the 
three  bomb  delivery  tasks. 

For  the  first  three  missions  simulated  wind 
conditions  were  calm,  but  starting  witli  the  fourth 
mission,  subjects  received  instruction  and  practice 
with  many  various  wind  directions  and  speeds. 

Testing  Piticedunea 

Criterion  performance  tests  were  administered 
in  the  F-SB  aircraft  for  all  groups  and  in  the  ASPT 
for  the  two  experimental  groups. 

F-5B  Tests.  Bach  subject  Hew  twu  flights  in 
the  F-5B.  The  lest  profile  Wius  identical  for  both 
flights  and  consisted  of  a total  of  nine  bombing 
patterns  on  each  tliglit.  The  F-5B  carries  six 
practice  bombs;  so,  with  three  tasks,  this  resulted 
in  the  delivery  of  two  bombs  per  task  per  sortie. 
One  extra  pattern  was  flown  on  each  task  so  a 
practice  run  could  be  tlown  prior  to  the  two  actual 
weapons  deliveries. 

Simulator  Tests.  The  last  two  sorties  in  the 
simulator  were  designed  to  give  the  subject  the 
same  proHles  on  the  simulated  range  that  he  would 
fly  on  his  two  aircraft  sorties.  Hach  delivery  was 
graded  using  the  same  weapons  delivery  criterion 
measure  used  on  the  aircraft  data  flights  and 
instruction  was  minimal.  For  the  scored  portions 
of  these  flights,  the  winds  were  set  to  represent 
conditions  typical  of  the  Gila  Bend  Gunnery 
Range. 


Scoring  Procedures 

AlUiough  the  same  gen»‘ral  approach  was  use  I, 
real-world  occurrences  naturally  beyond  ex  . 
mental  control  made  it  necessary  to  use  slightly 
different  scoring  procedures  for  the  aircraft 
criterion  missions  as  opposed  to  the  simulator 
criterion  missions. 

F-5B  Tests.  Ordnance  dropped  on  the  Gila 
Bend  Gunnery  Range  was  scored  by  observers 
positioned  in  towers  near  the  bombing  target. 
Upon  impact,  a small  powder  charge  in  each 
practice  bomb  discharged  a puff  of  white  smoke 
which  was  easily  visible.  Observers  in  the  two 
towers  used  sighting  transits  to  triangulate  the 
location  of  the  bomb  impact.  The  triangulation 
reading  were  used  to  compute  the  distance  of  the 
impact  from  the  center  of  the  target.  These 
circular  erroi  scores  were  relayed  via  radio  to  the 
aircraft  after  each  event.  Maximum  distance  for 
determining  circular  error  was  300  feet,  with  any- 
thing outside  this  limit  being  reported  as 
unscorable.  These  bombs  were  arbitrarily  assigned 
a score  of  301  feet  for  purposes  of  analysis. 

Occasionally  a malfunction  prevented  a bomb 
from  releasing  from  the  aircrat't.  Hiese  **no 
release*’  passes  were  rated  by  the  instructor  pilots 
since  the  pattern  was  flown  but  no  bomb  score 
was  recorded.  Tills  was  reflected  in  the  analysis 
with  some  subjects  having  fewer  total  opportu- 
nities which  were  adjusted  for  mathematically.  Of 
the  total  of  eight  malfunctions  that  occurred, 
there  were  seven  in  the  Control  Group,  and  one  in 
the  Motion  Experimental  Group. 

Simulator  Tests.  The  simulator  had  a 
theoretically  ur^limiteU  number  ol  bombs.  Each 
time  the  pilot  released  a simulated  bomb,  the 
instructor  received  a graphical  display  of  the  bomb 
impact  on  a cathode-ray  tube  which  depicted  the 
target  circle.  He  also  received  a printout  of  the 
exact  parameters  so  he  could  analyze  and  critique 
the  subjects'  performance.  Since  the  computer  was 
scoring  the  bombs,  there  \ 'ere  none  recorded 
“unscorable.”  No  release  malfunctions  occurred 
during  the  simulator  training. 


111.  RI-5ULTS 

The  research  performed  in  tliis  study  addressed 
three  objectives  which  may  be  simplified  into  the 
following  questions 

1.  Does  simulator  training  Improve  air- 
to-surface  weapons  delivery  skills  in  novice  pilots? 
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2.  jamiilniof  plntromi  iiintion  contribute 

1(1. my  in  siieli  training? 

j.  Doc:>  a fixed  uniouiU  ot  iumulalot  traiiilng 
affect  novice  pilots  of  higher  versus  lower  ability 
levels  to  the  same  extent? 

The  bypi^thesos  tested  in  the  analyses  of  results 
were  taken  directly  from  these  questions'.  (The 
source  tables  fur  these  analyses  arc  given  in 
ApptMidix  1'.)  Accordingly,  tlds  iicction  is 
organized  to  unswei  tiiese  questions  in  the  order  in 
which  they  appear. 

Tile  remaining  dependent  variable  set,  subject 
questionnaire  responses,  is  separately  analyzed  at 
t he  end  of  the  sect  ion.  Ikcausc  these  data 
consisted  of  subjective  opinions,  a quantitative 
analysis  was  not  possible,  but  wlicre  substantial 
response  concurrence  occurred,  it  is  identified  and 
reported. 

Simulator  Training  Effects 

llic  analysis  of  the  ASPT  training  effects  was 
based  on  a series  of  contrasts  between  the  Control 
Group  (C)  and  the  l‘-xperiincntal  Groups  (E|  and 
lij).  liic  data  collected  made  possible  four 
comparisons.  The  dc|)cndcnt  variables  used  for 
these  comparisons  were:  number  of  gunnery  range 
qualifying  bombs;  number  of  gunnery  range 
scorabic  brjmbs,  gunnery  range  bomb  circular 
error;  and,  instructor  pilot  ratings  on  F-SB  flying 
performance. 

Number  of  Quatlfyinf^  Ikmtbs.  A Chi>Squarc 
was  perfortred  to  lest  tor  significant  differences  in 
the  numbor  of  (]uaiilying  bomb  deliveries  made  by 
the  C and  gtcLijis.  Using  TAC  criteria, 

qualification  wa^.  defined  as  a circular  error  of  105 
feet,  or  less,  for  10-degree  and  15-degree  dive 
angles  and  140  fccM.  or  less,  for  (lie  ^0-degree  dive 
angle.  Iit)th  I:  groups  were  found  to  be  signifi- 
cantly better  than  tiie  ('  grnup  at  the  five  pcrccril 
level  of  confidence  (\^  ■■  Tabic  1 lists  the 

observed  values  and  percentages  for  the  three 
groujis. 


Table  1.  Number  of  Qualifying 
Bombs  ( I' raining  Effects  Analysis) 


Qualifying 

MIimi 

Number 

Pareantaga 

Nuni  bar 

Ptrcanlaaa 

c 

24 

27 

64 

73 

K, 

41 

4.1 

54 

57 

42 

44 

54 

56 

Numiyer  of  Sayrahlv  fkymbs.  Similar  to  the  first 
analysis»  riii-Sciuarc  was  used  to  test  for  significant 
ditlcrcnccs  in  the  mnnber  of  scorable  (circular 
error  of  300  feet,  or  less)  bombs  delivered  by  the 
C and  H groups.  Again,  the  H groups  were  signlfl* 
cuntly  better  at  the  five  peicent  level  of 
confidence  (x*  = 7. 82).  Table  2 lists  the  observed 
values  and  percentages  t'ur  the  three  groups. 


Table  2.  Number  of  Scorable  Bombs 
(Training  Effects  Analysis) 


Seorabia 

MIAMI 

Numbar 

ParoanUia 

Numbar 

Paroantafi 

c 

64 

72 

25 

28 

E, 

82 

86 

13 

14 

Ea 

82 

85 

14 

15 

Bomb  Deliver}^  Grcular  l:nvr.  Using  the 
circular  error  on  bomb  delivery  tasks  in  the  F-5B 
aircraft  as  the  dependent  variable,  a Lindquist 
Type  1 analysis  of  variance  was  conducted  to 
compare  tlie  C and  F groups.  The  overall  F value 
was  significant  at  the  five  percent  level  of 
confidence  (F  - 4,39)  and  a Tukey  Multiple 
Comparison  Test,  proved  both  E groups  to  be 
superior  to  the  C group  at  the  same  level  of 
confidence.  Tlicrc  were  no  significant  differences 
between  the  Ei  and  E^  groups.  Table  3 lists  the 
observed  means  for  each  group  on  the  three  bomb 
delivery  tasks. 


Table  J.  bomb  Delivery  Circular  Error 
Means  (Training  Effects  Analysis) 


diva  angla 

15°  diva  angia 

so"  diva  anfa 

20(y 

180' 

204' 

1', 

J48' 

138' 

169' 

138' 

144' 

159' 

Fly i n g Pe rfi > r rna rtce  Rat inffs.  The  same 
Lindquist  Type  I design  was  employed  to  analyze 
differences  between  the  C and  E groups  where  the 
dependent  measure  was  instructor  pilot  rating  of 
1-5B  Hying  performance.  Although  the  E groups* 
ratings  were  superior  to  tiiusc  assigned  the  C group 
at  the  20  percent  level  of  confidence,  the  F value 
was  not  significant  at  the  five  percent  level  (F  = 
2.36).  Table  4 lists  the  mean  ratings  received  by 
each  group  on  the  tluce  bomb  delivery  tasks. 
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Table  4.  Flying  Performance  Rating 
Meant  (Training  Effecti  Analyik) 


di¥i  inf  la 

is‘  diva  anfia 

SO*  diva  anila 

c 

44.6 

48.9 

49.4 

E. 

52.7 

52.7 

48.3 

49.4 

52.2 

51.1 

Platform  Motion  Effects 

Considerable  effort  wai  expended  on  the 
analyses  of  possible  simulator  platform  motion 
effects.  The  results  may  be  summarized  at  the 
outset  by  stating  that  none  were  found.  However, 
since  the  issue  Is  an  important  one  for  device 
configuration,  the  lack  of  significant  differences 
and  the  extreme  closeness  of  the  two  experimental 
gr 0 ups  on  the  dependent  measures  were  of 
interest. 

In  addition  to  the  dependent  variables 
previously  used  for  C and  £ group  contruts,  the 
simulator  data  were  also  available  for  analysii.  The 
approach  taken  followed  this  pattern,  analyzing 
F-SB  data  first  and  simulator  data  second. 

F-5B  Data:  Number  of  Qualifying  Bombs.  A 
Chi-Square  Test  performed  on  the  data  given  in 
Table  1 found  no  significant  differences  between 
the  Ej  and  Ej  groups  (:;*  * .01).  In  fact,  when  the 
hung  bomb  on  one  tadc  is  considered,  the  scores  of 
the  two  groups  are  identical. 

F'5B  Data:  Number  of  Scorable  Bombs,  A Chi- 
Square  Test  performed  on  the  data  given  in  Table 
1 also  showed  no  differences  between  the  Ei  and 
Ea  groups  (x^  = *03).  Again,  allowing  for  the  hung 
bomb  In  the  £ I group,  the  numbers  are  identical. 

F-5B  Data:  Bomb  Delivery  Circular  Frror.  Ihc 
Lindquist  Type  I analysis  of  variance  resulted  in 
no  significant  differences  (F  * .06)  between  the 
means  of  the  two  experimental  groups  (see  Table 
3). 

F-5B  Data:  instructor  Pilot  Ratings  of  Flying 
Performance,  As  before,  the  analysis  of  variance 
produced  no  significant  differences  (F « .03) 
between  the  mean  of  the  E|  and  Ea  groups  (see 
Table  4). 

The  analysis  of  the  simulator  training  data  for 
the  motion  and  no-motion  experimental  groups 
alio  failed  to  yield  tigniflcant  differences.  Four 
inalyMs  were  run  on  this  data.  The  tint  analysis 
used  bomb  delivery  circular  error  as  the  dependent 
vtiiabie  and  was  performed  to  determine  if  thcie 
was  an  initial  difference  between  the  two  groups. 


The  second  analysis  used  the  same  dependent 
variable  and  was  conducted  to  sec  if  the  groups 
differed  at  the  conclusion  of  their  simulator 
training.  The  third  and  fourth  analyses  paralleled 
tl)ese  Initial  and  final  comparisons  but  used  air- 
craft delivery  parameters  (airspeed,  heading, 
release  altitude,  G4oad,  and  dive  angle)  as  the 
dependent  variables  in  a multivariate  analysis  of 
variance. 

Initial  Bomb  Delivery  Qrcular  Ftn)r,  A 
Lindquist  Type  I analysis  of  variance  was 
performed  on  the  observed  average  bomb  delivery 
circular  error  recorded  for  each  subject  on  his 
initial  six  attempts  on  each  task(i.c.,  10-,  IS-,  and 
30*degrec  dive  angles).  The  results  showed  no 
significant  difference  at  the  five  percent  level  of 
confidence  (F  = .61).  Table  5 lists  the  observed 
means  for  each  group  on  the  three  bomb  delivery 
tasks. 


Table  5.  Initial  Bomb  Delivery  Circular 
Error  Means  (Motion  Effects  Analysis) 


to"  diva  aniia 

IB*  diva  anila 

SO*  diva  anila 

E, 

189* 

175' 

I5f 

E, 

ISl' 

126' 

159' 

final  Bomb  Delivery  Orcular  Frror.  The  same 
procedure  was  used  to  determine  if  the  E(  and  Ea 
groups^  final  performance  (eiglith  simulator 
mission)  on  these  tasks  differed  significantly.  At 
the  five  percent  level  of  confidence  this  was  found 
not  to  be  the  case  (F=  .00).  Table  6 lists  the 
observed  means  for  each  group  on  the  three  bomb 
delivery  tasks. 


Table  6,  Final  Bomb  Delivery  Circular  Enor 
Means  (Motion  Effects  Analysis) 


10*  diva  anila 

11*  diva  anila 

SO*  diva  anila 

E. 

107' 

104' 

129' 

E, 

121* 

86' 

13.V 

Initial  Aircraft  Delivery  Paramvtm,  The  basic 
“groups  by  tasks”  design  was  cMiiploycd  for  the 
multivariate  analysis  of  variance  performed  on 
aircraft  delivery  parameters  observed  for  the  initial 
three  simulator  missions.  Unlike  the  univariate 
cues,  there  were  five  dependent  variables  analyzed 
simultaneously.  Rao's  approximation  of  tlie 
F-distrlbutlon  provided  the  test  of  sigriificance 
(Tatiuoka,  1971).  The  result  was  an  R-vdue  of  .28 
which  is  not  significant  at  tlic  five  percent  level  of 
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confidence.  The  observed  mean  differences  from 
t)ie  ideal  value  for  each  aircraft  parameter  are 


given  in  Table  7 for  each  experimental  group  and 
task. 


Table  7.  Initial  Aircraft  Delivery  Parameters  (Motion  Effects  Analysis) 

to”  eiva  snilt  11°  eivt  antie  30"  diva  anila 


Heading 

1.57” 

Altitude 

85.04' 

Airspeed 

5.63  kti 

G-Load 

.18g 

Dive  Angle 

1.3^ 

Heading 

1.50" 

Altitude 

110.01' 

Airspeed 

4.51  kts 

G-load 

.14g 

Dive  Angle 

1.63*^ 

Heading 

2.52" 

Altitude 

55.10' 

Airspeed 

5.95  kts 

G-load 

.22g 

Dive  Angle 

1,05® 

Heading 

1.66" 

Altitude 

67.08' 

Airspeed 

7.55  kts 

G-load 

.18r 

Dive  Angle 

.83® 

Heading 

4,65" 

Altitude 

152.09' 

Airspeed 

6.06  kts 

G4oad 

Dive  Angle 

1.46® 

Heading 

3.20" 

Altitude 

111.50' 

Ainpeed 

5.11  kts 

G-load 

.33g 

Dive  Angle 

1.12® 

Final  Aircraft  Delivery  Parameters.  The  analysis 
of  the  aircraft  delivery  parameters  observed  on  the 
eighth  simulator  mission  was  identical  to  that  used 
above.  As  before,  the  test  for  significant  differ- 
ences was  Rao's  approximation  of  the  F- 
distribution,  and  the  result  was  an  R-value  of  1.63. 


This  was  not  significant  at  the  five  percent  level  of 
confidence.  Ihe  observed  mean  differences  from 
the  ideal  value  for  each  aircraft  parameter  are 
listed  in  Table  8 for  each  experimental  group  and 
task. 


Table  8.  Final  Aircraft  Delivery  Paramten  (Motion  Effects  Analysis) 


ie'*  aiva  Afifla 

ia°  eivaanna 

30*^  diva  anfla 

Heading 

1.39" 

Heading 

1,85" 

Heading 

3.21® 

Altitude 

82.61' 

Altitude 

98.71' 

Altitude 

117.57' 

El  Airspeed 

3.37  kts 

Airspeed 

4.24  kts 

Airspeed 

7.16  kts 

G-load 

• 19a 

G-load 

.19a 

G-load 

■25? 

Dive  Angle 

2.02® 

Dive  Angle 

.97® 

Dive  Angle 

1.05*^ 

Heading 

1.18" 

Heading 

1.40” 

Heading 

4.44" 

Altitude 

95.99' 

Altitude 

73.11' 

Altitude 

216.48' 

E}  Airspeed 

3.73  kU 

Airspeed 

8.00  kU 

Airspeed 

4.42  kts 

G-load 

.07a 

G-load 

G-load 

.26a 

Dive  Angie 

2.64® 

Dive  Angle 

1.09® 

Dive  Angle 

1,63® 

Subject  AbiUty  Levels 
and  Simulator  Trafaiing 

It  teemed  reasonable  to  hypothesize  that  train- 
ing in  the  ASPT  would  Improve  air-to-aurface 
weapons  delivery  ikflli,  but  an  interesting 
corollary  question  is:  Who  profits  most?  Is  such 
simulator  training  more  advantageous  for  the 
novice  pilot  of  superior  ability  or  for  the  novice 
pilot  ol  inferior  ability?  Bight  analyses  were 


performed  to  answer  this  question.  Ihe  first  four 
of  these  analyses  were  based  on  data  collected  in 
the  simulator;  the  second  four  used  data  collected 
during  the  aircraft  lortlf  s. 

Simulator  Data.  Using  the  Lindquist  Tvpe  1 
design,  four  univariate  analyses  of  variance  were 
conducted  to  determine  whether  ASPT  training 
was  more  beneficial  to  the  subjects  rated  u the 
upper  one-half  or  the  lower  one-half  of  the  dais 
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lr(Mn  Icud-in  ttamiin’,.  l\>i  all  ol  those  aualyses. 
bumh  delivery  ciuulai  atm  served  as  die 
dependent  variable. 

The  I'irsl  analysis  investigated  the  initial 
disparity  in  weapons  delivery  skills  between  the 
upper  onedudf  and  lower  one-hair  grout>s,  It  was 
rather  surprising  to  find  that  the  groups  did  not 
differ  significantly  at  the  five  percent  level  of 
conrtdence  .58).  1'able  gives  the  initial 
attempts  obiscrvcd  means  for  each  group  on  (he 
three  bomb  delivery  tasks  studied. 


7'ah!c  ‘A  Initial  Bomb  Ilelivery  Circular 
Error  Meaas  (Student  Ability  Analysis) 


10"  diva  anfila 

is"  diva  «n«la 

10"  divd  ■nilt 

Upper  1;2 

17H* 

1 14* 

152* 

Lower  1/2 

174* 

187* 

158* 

At  the  conclusion  of  the  simulator  training, 
however,  there  was  a definite  difference  In  degree 
of  skill  shown  by  the  two  groups.  'Idrc  I ‘-value 
equaled  3. 1 4 and  was  signillcanl  at  the  five  per- 
cent level  of  confidence  with  u directional 
hypothesis.  Table  U)  gives  tlic  final  attempt 
observed  means  for  eacli  group  on  tlie  three  bomb 
delivery  tusks. 


Table  10.  Final  Bomb  Delivery  Circular  Error 
Means  (Student  Ability  Analysis) 


to"  diva  anila 

1 s"  diva  anili 

30"  divt  mitt 

Upper  1/2 

K6' 

V6* 

un* 

l.owei  1/2 

1 .12* 

V4* 

15.V 

Tlie  percentage  of  improvement  demonstrated 
in  each  task  was  computed  ftn  the  two  groups. 
Table  1 1 presents  lliesc  data.  Tlie  “average’' 
improvement  was  30  j)crcent  for  the  upper  one* 
half  group  and  2b  percent  for  the  Itiwcr  one-half 
group. 

Table  U,  Percent  improvement  in  Bomb 
Delivery  Circular  Error  (Student 
Ability  Analysis) 


to"  dlvt  inflt 

It"  diva  mfla 

30“  dlvt  artflt 

Upper  1/2 

4(,,)l 

16% 

28% 

Lower  1/2 

b\% 

50"^. 

.1% 

To  see  if  tlie  improvement  shown  by  the  upper 
onc  haif  group  was  significant,  Lindquist  Type  1 
analysis  of  variance  was  performed  on  the  initial, 
as  contrasted  to  the  final,  circular  error  scores.  13tc 


resulting  l'*v:duo  ot  I 1.15  was  significant  at  tiic 
five  tH'rcent  level  ol  cimndena'.  When  the  same 
analysis  was  run  on  the  lower  one-hall'  group,  the 
F-value  wo:s  not  signiilcant  at  tlie  five  percent  level 
(F=  1.95). 

Aircraft  f'our  analyses  on  upper  one-half 
versus  lower  one-half  subjects  were  run  using  the 
data  from  tlie  F-5!)  sorties  as  the  dope  mien  t 
variables,  lire  first  analysis  was  a (’hi-Scjuare  Test 
on  the  number  of  qualifying  bombs  delivered  by 
the  two  groups.  The  resulting  Chi-Square  value  of 
1.57  was  not  significant  at  the  five  percent  level  of 
conildence  (Table  12), 


Table  / J.  Number  of  Qualifying  Bombs 
(Student  Ability  Analysis) 


Qualifying 

Mlutt 

Numbtr 

PtretnUfit 

Numbtr  Ptretntaga 

Upper  1/2 

46 

48 

50 

5 2 

Lower  1/2 

57 

V) 

58 

61 

Tlie  second  analysis  was  essentially  u repeat  of 
the  first,  except  tlial  number  of  scorablo  bombs 
was  used  us  the  dcj^endcnt  variable.  Again,  the 
Clii-Squarc  Test  was  not  significant  at  the  five 
percent  level  (x^  = 1.1b).  Table  13  gives  the 
observed  values  and  )>crccntagcs  for  the  two 
groups. 


Table  13,  Number  of  Scorable  Bombs 
(Student  Ability  Analysis) 


SooraMt 

M|m1« 

Numbtr  Ptreentaga 

Num  bar 

Paroa  ntagt 

Upper  1/2 

85  HH 

I ( 

12 

Lower  1/2 

K.t 

U) 

17 

When  bomb  dcllvciy  circular  error  was  used  as 
the  dependent  variable,  tlie  Undiiuist  Type  1 
analysis  of  variance  resulted  in  an  I'-value  of  .73 
which  was  not  slgiiillcaiit  at  tlie  live  perccnl  level 
of  confidence,  'fable  14  gives  the  means  for  each 
group  on  tlie  three  bomb  delivery  tasks. 


Table  14,  Bomb  Delivery  Circular  Error 
Means  (Student  Ability  Analysis) 


1 a"  diva  anglt 

is"  dlvt  anglt 

30"  dlvt  anglt 

Uppei  1/2 

lUJ* 

16  2' 

14.5* 

Ltrwer  1/2 

154* 

1 TV 

1K4' 
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Hr’  siiinc  Jcsi|»n  was  used  to  evaj  jate  instructor 
pilot  raliiif's  ot  I -MJ  IlyiiH’.  pertonnana’  tor  tlie 
two  groups,  llie  resulting  l -valuc  of  1.22  was  not 
significant  at  tlie  live  percent  level  of  confidence. 
Table  15  lists  tlie  nieaiis  ratings  received  by  each 
group  on  the  three  bomb  delivery  tasks. 


Table  15.  Flying  Performance  Rating 
Means  (Student  Ability  Analysis) 


1 0"  diva  ansi# 

is"  dlvt  angU 

30"  dWt  idflt 

i/2 

■S2,7 

.su 

52,7 

biwci  1/2 

4^1.4 

5S.H 

46.7 

'Hie  end  result  of  tliese  four  analyses  was  that 
althougli  none  individually  reached  ttic  five 
percent  level  of  confidence,  when  viewed 
collectively,  they  offered  strong  evidence  that  it 
was  the  superior  students  who  gained  most  from 
the  simulator  training,  Tlie  outcomes  of  all  four 
analyses  were  in  the  same  direction.  When  the 
actual  probability  levels  of  the  Clii-Square  and 
F-Tcst  were  taken  into  consideration,  the  level  of 
confidence  reached  was  far  beyond  the  five  per- 
cent point. 

Questionnaire  Analysis 

The  open-ended  questionnaires  were  naturally 
not  amenable  to  quantitative  analysis  but  did 
provide  a valuable  source  for  insights  into  tiic 
subjects'  attiturics  and  opinions  about  the 
program,  AJthougli  the  feelings  expressed  by  the 
subjects  were  sometimes  diamctriciilly  opposed  to 
one  another,  there  was  considerable  consensus  us 
to  the  program  components  on  wliich  comments 
were  made.  Piis  result  was  interpreted  as  the 
significant  findings  rc^Talcd  by  the  questionnuiie, 
Tlie  statements  listed  below  comprised  the  essence 
of  the  point  (or  counterpoint)  reported  by  25 
percent,  more,  )l  the  subjects. 

1.  ‘ In  general,  it  was  u good  program  and  the 
training  wu:^  higiily  beneficial/*  Tliis  opinion  was 
expressed  by  nearly  all  subjects.  None  reported 
negative  feelings. 

2.  “Hie  objectives  of  the  program  were  well 
explained."  Subject  opinion  was  unanimous  on  this 
point. 

"Tlie  orientation  to  the  l*'-5B  was  sparse.” 
Many  subjects  believed  they  could  have  performed 
better  on  llie  gunnery  range  if  there  had  been 
more  lime  to  fly  and  become  familiar  with  the 


l'-5B.  Iliis  is  most  probably  true,  but  study 
constraints  could  not  allow  additional  sorties. 

4.  "More  would  have*  been  learned  if  the 
simulator  sortie  were  1.5  hours  in  duration  rather 
than  1 hour.”  Of  the  subjects  who  addressed  this 
point,  one-half  favored  the  longer  training  session, 
but  the  other  half  desired  slu^rtcr  sessions  with 
interspersed  breaks. 

.5, -“Two  F-5B  rides  were  not  enough  to 
demonstrate  what  wjis  actually  learned  in  ASPT.“ 
Due  to  the  different  flight  characteristics  between 
the  ASPT  and  tlie  F-SB,  some  subjects  believed 
their  gunnery  range  performance  was  degraded 
because  they  had  not  fully  readjusted  to  the  air- 
craft. 

6.  “The  fliglit  characteristics  of  ASPT  sliould 
more  closely  resemble  those  of  the  F-5B."  This 
comtfieiU  is  merely  u restatement  of  tlic  previous 
point. 

7.  “l^iere  should  be  more  simulator  rides  with 
higher  winds.”  This  desire  for  more  simulator 
training  reflects  favorably  upon  the  perceived 
value  of  the  program. 

8.  “The  siglit  picture  should  be  erniiliasl/cd  in 
the  simulator  training.”  This  observation  should  be 
implemented  in  future  ASIH'  research  applications. 


IV.  DISCUSSION 

Because  the  study  was  so  basic,  Its  method- 
ology so  in  conformance  with  typical  Air  Force 
training  operations  am)  tlic  results  so  clcarclit, 
there  is  little  to  lx*  added  to  that  already 
presented.  Tficrefore.  this  section  will  consist  of 
only  a few  brief  statemenl.s  summarising  the 
effects  of  generuli/ed  air-lo-suifacc  simulator 
weapons  training,  simulator  platform  motion,  and 
student  abihty  a.s  a variable  in  sinuilator  training. 

Simulator  Training 

Tlie  answer  to  the  question,  “IXics  gencrali/ed 
air  to-surfacc  simulator  weapons  delivery  training 
transfei  to  a specific  aircral’t?"  is  an  unqualified 
"yes.”  Perhaps  tfie  most  iitiportaiit  aspect  of  this 
result,  in  terms  of  its  implications  for  simulator 
and  training  [irogram  ilcsign,  is  tlie  fact  that  the 
ASIT  was  configured  as  a T-.^7  (with  a sighting 
device)  and  still  there  was  significant  tranter  of 
training  to  tlie  I -511.  Altluuigh  the  finding  that  a 
low  fidelity  device  can  provide  considerable 
training  when  properly  employed  is  not  new 


(Prophet  & Boyd,  U^70),  l!»e  study  was  a rather 
striking  confirmation  of  the  point. 

There  is  little  doubt  that  the  training  given  by 
the  program  was  highly  beneficial  to  the  novice 
pilots  who  served  as  subjects.  Both  the  control  and 
experimental  groups  gained  valuable  experience  in 
air-to-surface  weapons  delivery  with  the  experi- 
mental groups  receiving  the  most. 

Platform  Motion 

It  is  impossible  to  prove  the  null  hypothesis, 
but  the  results  of  the  study  show  unequivocally 
that  slx-dcgrec-of-frecdom  platfomi  motion  did 
not  enhance  the  training  vaJue  of  the  simulator. 
Considering  the  aerial  weapons  delivery  task,  this 
is  not  a surprising  finding.  The  task  Is  primarily 
visual,  and  motion  (or  movement)  serves  only  as 
an  alerting  stimulus  to  the  pdot. 

The  fact  has  signlficunt  ramifications  for 
simulator  design.  'Hie  deletion  of  platform  motion 
requirements  for  air*to*surface  simulation  would 
have  enormous  cost-avoidance  consequences.  It  is 
believed  that  a G-seat  and  G-suit  (wltli  appropriate 
stick  and  pedal  “shakers'*)  would  provide  ail 
necessary  “motion"  cues  needed  for  this  simula- 
tion 

Student  Ability 

In  this  study,  it  was  tlic  better  novice  pilot  who 
profited  tlic  most  from  the  ASPT  training.  In 
respect  to  their  demonstrated  weapons  delivery 
skills,  the  up[>er  onc-hulf  and  lower  onc-half 
groups  of  student  started  statistically  equal.  At  the 
conclusion  of  tlie  simulator  training,  however,  the 
upper  onc-hulf  had  made  signiilcant  improvement 
(at  the  five  percent  Icvt  1 of  confidence)  from  its 
starting  point.  Althougli  the  average  pcrfomiancc 
of  the  lower  onc-half  hud  also  improved,  it  was  not 
signiilLimt  ut  this  level  of  conndcnc<^ 


Tlie  fact  that  the  bctlor  student  u.sually  profits 
more  when  given  fixed  amounts  of  practice  and 
receives  the  greatest  benefits  from  innovations  in 
training  and  education  is  a fairly  common  observa- 
tion, llie  same  general  finding  also  occurs  even 
when  the  content  of  the  training  program  syllabus 
remains  constant,  but  new  media  are  introduced  to 
convey  this  subject  matter.  That  the  present  study 
was  no  exception  to  this  general  rule  adds  face 
validity  to  the  results  obtained. 


V.  HERSPhCnVE 

The  study  was  performed  to  answer  three 
questions  dealing  with  the  role  and  effects  of 
simulation  when  applied  to  training  the  acquisition 
of  alr-to-surface  weapons  delivery  skills  in  novice 
pilots.  Further,  in  order  to  produce  results  of 
strong  generalization,  the  study  was  conducted  in 
a manner  that  was  completely  realistic  from  an 
operational  viewpoint. 

Although  only  24  individuals  were,  used  as 
subjects  (eight  each  in  a control  and  two  experi- 
mental groups),  the  treatment  effects  were  so 
powerful  that  clcar-cut  results  emerged. 
Consequently,  tlie  findings  of  the  study  may  be 
briefly  summarized  in  the  following  three 
statements; 

1.  Conventional  uir-to-surface  weapons 
delivery  training,  as  accomplished  using 
low-fidelity  simulation,  has  significant  transfer  to  a 
specific  aircraft. 

2.  Slx-dcgrccaffreodom  platform  motion 
docs  not  contribute  to  this  higlily  effective 
training. 

3.  Novice  student  pilots  of  greater  (os  con- 
trasted to  lesser)  InitiJ  ability  benefit  most  from 
such  simulator  training  when  a minimum  fixed 
number  of  trials  is  used. 
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APPENDIX  B:  STUDENT  QUESTIONNAIRES 


NAME:  ID  NUMBER: 

DATE:  GROUP:  

1.  Total  number  of  flight  hours:  

a.  A/C  type:  flight  hours:  

b.  

c.  

d.  

2.  Total  number  of  simulator  training  hours:  

a.  Sliiiulator  type:  training  hours:  

b.  

c.  

2a.  Were  the  training  objectives  of  this  special  program  clear  to  you: 


b.  Whati  If  anything,  was  not  clear? 


3a.  Was  the  Instruction  well  managed  and  presented? 


b.  If  not,  what  areas  would  you  change? 


4a.  Were  there  areas  of  Instruction  you  felt  were  Incomplete? 
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APPENDIX  C:  MANAGEMENT  TRAINING  SCHEDULE 
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MANAGEMENT  SCHEDULE 


MP— ijjUifclil  1 

Academics 

n 2 3 r 

5 6 7 

Control  Group 

Experimental  Groups 

1.2 

1 

2 

Simulator  Sorties 
Experimental  Groups 

1,2  3,4  5,6 

7.8 

Aircraft  Sorties 
Control  Group 
Experimental  Groups 

1 2 

1 2 

CONTROL 

GROUP 

0900  Bldg  558  0600 

Conf  Rm 

Pilot  1 GAl 
IP  1 

Pilot  2 GA2 
IP  ] 

1000  GA  Review 

Pilot  2 GAl 
IP  2 

Pilot  1 GA2 
IP  2 

1100  Hospital 
Fit  Surg 

1200  Lunch 

1300  F-5  Brief 

Bldg  42 

IP  1 Capt  Seymour 

IP  2 Capt  Hukee 

Pilot  1 Hargarten 
Pilot  2 Hamilton 
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Air-to-6round  Experiaental  Groups  Schedule 
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APPENDIX  D;  SIMULATOR  TRAINING  SCHEDULE 


ASUPT  GAl 


NAME: 

IP  NAME: 


DATE: 

TIME: 


FAHILIARIZATI0N/10°  HIGH  DRAG 


15  min 


INIT  005 

1 

Free  flight  - aero,  trim  checks 
100  knots  to  300  knots 

Demo 

1 

Part  task  10  deg 

Reset 

4 

Part  task  10  deg 

Demo 

1 

Part  task  10  deg 

Reset 

1 

Part  task  - Record 

1 

Playback 

Reset 

2 

Part  task  10  deg 

Demo 

1 

Full  pattern  10  deg 

Reset 

6 

Full  pattern  10  deg  (Repeat  Demo  once.) 

(One  Record/Playback. ) 

ASUPT  GA2 


NAHE: 

IP  NAME: 


INIT  093  1 

Continue  5 

T5 

Demo  1 

Reset  4 

Demo  1 

Reset  1 

1 

Reset  2 



Demo  1 

Reset  6 

TO 

Init  091  2 

Continue  2 

TO 


DATE: 

TIME: 

15°  HIGH  DRAG 

Part  task  10  deg  

Full  pattern  10  deg 


Part  task  15  deg 

Part  task  15  deg  

Part  task  15  deg 

Part  task  - Record  

Playback 

Part  task  15  deg  

Full  pattern  15  deg 

Full  pattern  15  deg  (Repeat  Demo  once.) 

(One  Record/Playback. ) 


Full  pattern  10  deg 
Full  pattern  15  deg 


33 


I 


ASUPT  6A3 


NAME:  

IP  NAME:  

30®  DIVE 

INIT  091  2 Full  pattern  10  deg 

Continue  4 Full  pattern  15  deg 

To 


Demo  1 Part  task  30  deg 

Rwet  4 Part  task  30  deg  

0*mo  1 Part  task  30  deg 

R«s«t  1 Part  task  - Record  

1 Playback 

Reset  2 Part  task  30  deg 

30  

Demo  1 Full  pattern  30  deg 

F Full  pattern  30  deg  (Repeat  Demo  once.) 

(One  Record/Playback.) 


13 

INIT  091  2 Full  pattern  10  deg 

Continue  2 Full  pattern  IS  deg 

Continue  2 Full  pattern  30  deg 

53 


34 


ASUPT  GA4 


NAME: 

IP  NAME: 


15 


VS 


?0 


DATE: 

TIME: 


INIT  091 

2 

WIND  ADJUSTMENTS 
Full  oattern  10  dea 

Continue 

2 

Full  oattern  15  deq 

Continue 

4 

Full  oattern  30  deq 

Demo 

1 

10  dog  - 090/10 

Reset 

4 

Full  pattern  10  deg.  090/10 

4 

Full  pattern  10  deg,  360/10 

4 

Full  pattern  10  deg,  045/10 

3 

Full  pattern,  15  deg,  090/10 

3 

Full  pattern,  30  deg,  090/10 
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ASUPT  GAB 


NAME : 

IP  NAME:  

INIT  091  2 

2 

2 


3 

3 

1o 

INIT  093  2 

2 

2 

INIT  091  2 

2 

2 

50 


DATE : _ 
TIME:  _ 

WIND  ADJUSTMENTS 

Full  pattern  10  deg  270/10 

Full  pattern  15  deg  270/10 

Full  pattern  30  deg  270/10 

Full  pattern  10  deg 

Full  pattern  15  deg 

Full  pattern  30  deg 

Full  pattern  10  deg  225/20 

Full  pattern  15  deg  225/20 

Full  pattern  30  deg  225/20 

Full  pattern  10  deg  315/10 

Full  pattern  15  dag  315/10 

Full  pattern  30  deg  315/10 
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ASUPT-6 


NAME:  

IP  NAME:  

INIT  091  3 

3 

T5 

INIT  091  3 

3 
3 

15 

INIT  091  3 

3 
3 




DATE: 

TIME: 

WIND  ADJUSTMENTS 
15  deg  no  wind 

30  deg  no  wind 

10  deg  290/5 
15  deg  290/5 
30  deg  290/5 

10  deg  110/15 
15  deg  110/15 
30  deg  110/15 
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NAME: 

IP  NAME: 


ASUPT  7 


DATE: 


TIME: 

BOMBING  FOR  QUALIFICATION 

TEST 


INIT  091 

1 

10  deg  (dry)  310/10 

2 

10  deg 

310/10 

1 

15  deg  (dry)  310/10 

2 

15  deg 

310/10 

1 

30  deg  (d*.y)  310/10 

2 

30  deg 

310/10 

Practice 
INIT  091 

3 

10  deg 

135/25 

3 

15  deg 

135/25 

3 

30  deg 

135/25 

INIT  091 

3 

10  deg 

045/5 

3 

15  deg 

060/12 

3 

30  deg 

090/15 
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ASUPT  8 


NAME: 

IP  NAME; 


TEST 
INIT  091 


Practice 
INIT  091 


Test 
INIT  091 


ro 


DATE; 

TIME: 

BOMBING  FOR  QUALIFICATION 

1 >10  deg  (dry)  030/8 


2 

10  deg 

030/8 

1 

15  deg  (dry) 

030/8 

2 

15  deg 

030/8 

1 

30  deg  (dry)  030/8 

2 

30  deg 

030/8 

3 

10  deg 

110/10 

3 

15  deg 

110/10 

3 

30  deg 

110/10 

1 

10  deg  (dry)  240/10 

2 

10  deg 

240/10 

1 

15  deg  (dry)  240/10 

2 

IS  deg 

240/10 

1 

30  deg  (dry) 240/ 10 

2 

30  deg 

240/10 

APPENDIX  E:  ANALYSIS  OF  VARIANCE  SOURCE  TABLES 


40 


Training  Effects  Analysis 
Boob  Dalivary  Circular  Error 
Souz^a  Tabla 


Sourca 

df 

ss 

MS 

P>^tlua 

Batwaan-^ubjacta 

33 

112893 

4908 

B 

2 

33264 

16632 

4.39 

arror  (b) 

21 

79629 

3791 

Wlthln-Sub J act a 

4d 

134314 

2798 

A 

2 

6537 

3268 

1.09 

AB 

k 

1884 

471 

.16 

arror  (w) 

42 

125892 

2997 

Total 

71 

2472O8 

Trainin 

Flying 

g Effects  Analysis 
Performance  Rating 
Source  Table 

Soui'ca 

df 

ss 

MS 

F-valua 

Betwean-Subjaota 

17 

593 

34 

B 

2 

141 

70 

2,36 

error  (b) 

15 

451 

30 

Withii>-SubJoeta 

36 

1125 

31 

A 

2 

54 

27 

.86 

AB 

4 

132 

33 

1.06 

error  (w) 

30 

939 

31 

Total 

53 

1718 
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Motion  Effects  Analysis 
Bomb  Delivery  Circular  Error 
Source  Table 


Source  ** 

Between-Subjeota  15 

B 1 

error  (b)  H 

Wlthln-Subjects  32 

A 2 

AB  2 

error  (w)  2B 

Total 


S3 

MS 

F-value 

66277 

4418 

261 

261 

.06 

66016 

4715 

73287 

2290 

5054 

2527 

1.05 

748 

374 

.16 

67485 

2410 

139565 


Motion  Effects  Analysis 
Flying  Performance  Rating 
Source  Table 


Source 

df 

S3 

MS 

F-value 

Between-Subjecte 

11 

401 

36 

B 

1 

1 

1 

.03 

error  (b) 

10 

400 

40 

Wlthin-Subjects 

24 

716 

29 

A 

2 

45 

22 

.74 

AB 

2 

55 

27 

.89 

error  (w) 

20 

616 

30 

Total 

35 

1118 
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Motion  Effects  Analyst t 
Initial  Bomb  Delivery  Circular  Ezror 
Source  Table 


Source 

df 

SS 

KS 

F-value 

Between-Subjects 

15 

196744 

13116 

B 

1 

6342 

8242 

.61 

error  (b) 

14 

188502 

13464 

Wi thln-Sub J ect 8 

32 

203345 

6354 

A 

2 

3159 

1579 

.23 

AB 

2 

7443 

3721 

.54 

error  (w) 

2d 

192742 

6883 

Total 

47 

400089 

Motion  Effects  Analysis 
Final  Bomb  Delivery  Circular  Error 
Source  Table 

Source 

df 

SS 

<MS 

F-value 

Between~SubJects 

15 

43853 

2923 

B 

1 

.5 

.5 

.00 

error  (b) 

14 

43852 

3132 

Wlthin-Subjecta 

32 

58274 

1821 

A 

2 

10594 

5297 

3.2^ 

AB 

2 

2237 

1118 

.69 

error  (w) 

28 

45442 

1622 

Total 

47 

102127 

4S 


student  Ability  Analysis 
Initial  Bomb  Delivery  Circular  Error 
Source  Table 


Source 

df 

S3 

MS 

P-value 

Betvreen-Subjeots 

15 

187840 

12522 

B 

1 

7425 

7425 

.58 

error  (b) 

14 

180415 

12886 

Wlthln~SubJeota 

32 

205345 

6417 

A 

2 

5817 

2908 

•44 

AB 

2 

14111 

7055 

1.07 

error  (w) 

28 

185416 

6622 

Total 

47 

393185 

Student  Ability  Analysis 
Pinal  Bomb  Delivery  Circular  Error 


Source  Table 

Source 

df 

SS 

MS 

F-^alue 

Between~Sub Jec t a 

15 

43853 

2923 

B 

1 

8034 

8C'‘, 

3.14 

error  (b) 

14 

35818 

2558 

Withlxv-Subjeota 

32 

58274 

1821 

A 

2 

10594 

5297 

3.45 

AB 

2 

4725 

2362 

1.54 

error  (w) 

28 

42954 

1534 

Total 

47 

102127 

46 


student  Ability  Analysis 
Upper  1/2  Initial  Vereua  Final  Circular  Error 
Source  Table 


Source 

df 

SS 

MS 

F-value 

Betweenp-Sub  J ect  s 

15 

56202 

3746 

B 

1 

27217 

17217 

13.15 

error  (b) 

lA 

28964 

2070 

Withdiv-Subjects 

32 

65163 

2036 

A 

2 

9206 

4603 

2.70 

AB 

2 

8293 

4146 

2.44 

error  (w) 

2d 

47664 

1702 

Total 

47 

121366 

Student  Ability  Analysis 
Lower  1/2  Initial  Veraue  Final  Circular  Error 
Source  Table 


Source 

df 

SS 

MS 

P-value 

Between>.SubJeot0 

15 

213336 

14222 

B 

1 

26O86 

26086 

1.95, 

error  (b) 

14 

187249 

13374 

Withln-Subjeote 

32 

190455 

6201 

A 

2 

2023 

IQll 

.16 

AB 

2 

15726 

7863 

1.22 

error  (w) 

28 

180706 

6453 

Total 

47 

411792 

47 


student  Ability  Analysis 
Bomb  Delivery  Clrauler  Itrror 
Source  Table 


Source 

df 

SS 

MS 

F-^alue 

Between-Subjeote 

15 

58544 

3902 

B 

1 

2914 

29H 

.73 

error  (b) 

14 

55630 

3973 

Wlthli>-SubJeots 

32 

78221 

A 

2 

5966 

2983 

1.39 

AB 

2 

12138 

6069 

2.83 

error  (w) 

28 

60116 

2147 

Total 

47 

136765 

Student  Ability  Analysis 
Flying  Performance  Rating 
Source  Table 

Source 

df 

SS 

MS 

F-value 

Between-Subjeota 

11 

401 

36 

B 

1 

43 

13 

l.r>2 

error  (b) 

10 

353 

35 

Wlthln«SubJeota 

24 

716 

29 

A 

2 

45 

22 

.83 

AB 

2 

121 

60 

2.20 

error  (w) 

20 

550 

27 

Total 

35 

1118 
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